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Noise reduction. 



The invention relates to a noise reduction filter, more particularly to a 
filter for image data noise reduction. The invention also relates to a noise reduction filtering 
method and to an image signal receiver comprising a noise reduction filter. 



Noise reduction of image data is generally realized through averaging of 
likely correlated picture elements. The likelihood may be due to spatial or temporal 
proximity. The closer the proximity, the higher the likelihood that picture elements (pixels) 
have the same value if noise were not present. Both linear and non-linear filters have been 
10 used for noise reduction purposes, as well as the intermediate solution of adapting filter 
coefficients to local picture statistics. 

The article "Extended-Order Statistic Filter and Evaluation of Noise 
Reduction Performance", Electronics and Communications in Japan, Part 3, Vol. 74, No. S, 

1991, pp. 1-11, discloses an extended-order statistic filter for image data noise reduction. 

f 

15 The distinction between order statistic filters (OSF) and linear filters is that in an OSF, 
weighting coefficients are not related to the spatial or temporal distance with respect to the 
current sample, but to the order of the samples after ranking them on the basis of their signal 
value. In the extended-order statistic filter described in the article, the coefficients not only 
depend on the order of the signal values, but also on the order of differences between the 

20 signal values of neighboring samples and the signal value of the current sample (differential 
OSF), and further on the distance to the current sample. It was shown that this type of filter 
can combine the advantages of linear and non-linear filtering on gaussian noise and impulse 
noise, respectively. The transversal nature of these filters makes them rather expensive when 
applied to profit from the temporal correlation in image sequences. 

25 JP-A-2/67,688 shows an image noise removing system in which, to 

prevent the generation of blur, filter characteristics are based on a relation between a central 
pixel and a weighted averaged pixel in the case of filtering a pixel positioned on the 
boundary of blocks. A weighted average of a central pixel and eight neighboring pixels 
surrounding the central pixel is determined. If the difference between the central pixel and 
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the weighted average is smaller than a threshold, the weighted average is supplied, whereas 
when the difference exceeds the threshold, the unfiltered central pixel is supplied. 

DE-C-39.27. 101 shows a noise reduction filter in which a delayed 
luminance signal and an undelayed luminance signal are only averaged if their difference is 
smaller than a given value. This corresponds to the noise removing system of JP*A-2/67,688 
if instead of eight neighboring pixels surrounding the current pixel, only one neighboring 
pixel above the current pixel would be present. All disadvantages of the system of JP-A- 
2/67,688 are still present; in fact, the circuit of DE-C-39.27.101 can be considered as a 
primitive embodiment of the system of JP-A-2/67,688. 

The article ''Symmetrical recursive median filters; application to noise 
reduction and edge detection", by Ph. Bolon et al., Signal Processing V: theories and 
applications, pp. 813-816 shows a recursive median filter for noise reduction. A median filter 
is a species of the class of order statistic filters. The symmetrical filter described in the 
article, shows the disadvantage that for two-dimensionally filtering a current input pixel, 
information from the ''future" (Le. pixels below the current pixel when the pixels are 
scanned from top to bottom) is required, which is unattractive in view of a hardware 
realisation. 

20 It is, inter alia, an object of the invention to provide a filter which 

provides a better reduction of low-frequency noise components. For this purpose, a first 
aspect of the invention provides a noise reduction filter as defined in claim 1. A second 
aspect of the invention provides an image signal receiver as defined in claim 12. A third 
aspect of the invention provides a noise reduction filtering method as defmed in claim 13. 

25 Advantageous embodiments of the invention are defined in the subclaims. 

In accordance with the present invention, instead of directly neighboring 
input pixels, pixels at some horizontal and/or vertical distance are used. It appeared that 
thereby, low-frequency noise components were reduced in addition to the high-frequency 
noise components which can also be reduced when directly neighboring input pixels are used. 

30 In one preferred embodiment, the recursive noise reduction filter receives 5 filtered pixels 
from the previous line having a distance of 4 pixels between two successive input pixels, 3 
unfiltered pixels from the present line having a distance of 2 pixels between two successive 
input pixels. A ringing effect occurring at edges appeared to be reduced when the filtered 
input samples from the previous tine were taken from positions shifted in the horizontal 
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direction line-altematingly by +1, 0, -1, 0, +1, ... pixels. Many variations in the inter-pixel 
distance, the nurnb^ of pixels used» and the magnitude of the line-alternating shift in the 
position of the filtered input pixels taken from the previous line are possible. In one 
embodiment, the inter-pixel distance d^nds on an edge-detection such that the inter-pixel 
5 distance decreases with an increasing difference between a current pixel and one of the 
neighboring pixels (e.g. the neighboring pixel having the largest distance to the current 
pixel). The inter-pixel distance may vary separately for left and right neighboring pixels. 

These and other aspects of the invention will be apparent from and 
elucidated with reference to the embodiments described hereinafter. 

10 

In the drawing: 

Figs. 1 A and IB show block diagrams of embodiments of a noise 
reduction filter in accordance with the present invention; 
IS Figs. 2A-2D show several configurations of neighboring pixels; 

Fig. 3 shows an embodiment of a transversal noise reduction filter in 
accordance with the present invention; 

Fig. 4 shows a switchable two-pixel delay circuit for use in the noise 
reduction filter of Fig. 3; and 
20 Fig. S shows a block diagram of a preferred difference-dependent 

weighted average filter for use in the noise reduction filters of Fig. lA, IB and 3. 



The embodiments of the invention shown in Figs. lA, IB concern non- 
25 • linear recursive spatial or spatio-temporal filters. Other embodiments relate to transversal 
noise-reduction filters, while the invention is not limited to non-linear filters. Experiments 
indicate that the filters are attractive for use in future television receivers, as their 
performance is certainly superior to that of the presently used motion-adaptive temporal 
recursive filters, while their complexity is practically equivalent. In a preferred embodiment, 
30 for every pixel position ji ^ (x, //, with T indicating transposition, and input luminance 
signal F(2>f the proposed filter output Fpfji) will be defined as: 
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(1) 



where A/^ and N2 are sets of vectors defining one, two, or three-dimensional neighborhoods. 
The recursivity of the filter results from the third term of equation (1) where the constant 5 
controls the amount of recursivity. Further, in accordance with the present embodiment of 
the invention and in contradistinction to an OSF or a differential OSF, filter weighting 
coefficients a(p, q) and O) related to the absolute difference between the weighted 
pixel and the current input pixel: 



fl) =/,(|^(e)-^(2*fl) I) 
0iR. fl) -f2i\F(R)-F^^n)\) 



(2) 



with/, and^ monotonously decreasing functions. In equation (1), G is a gain or 
normalization factor: 

:J-^-l*7.E fl)+«.E fl) 



(3) 



An attractive implementation results if the filter weighting coefficients are selected according 
10 to: 



of(2, fl) = 



1, {\Fi2^n)-F(2)\ < Th,) 
0. (|F(£ + /i)-F(fi)l ^T\) 



(4) 



and: 



fl) = 



1, [\F^^n)-F{R) \ <Th,) 
0, {\F^^n)'Fi2)\ ^Th^) 



(5) 



respectively. 

Allowing only spatial recursion (only line memories, no field memories), good results were 
obtained using the following neighborhoods: 
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(7) 



while selecting W = 0,25, TTij = and 7 = 5=1, where 77i, was adapted to the noise 

level. As can be seen from equations (6) and (7), the neighborhoods are selected such that 
pipe-lining of the algorithm implemented in a very large scale integration (VLSI) is simple. 

When allowing for field memories in the design, a three-dimensional noise 
reduction filter can be realized, for which experimentally good results could be shown, 
applying the following neighborhoods: 
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(9) 



10 where Ufy^ 0 — (Dj,, is the displacement vector describing the motion between field at 
time t and the previous field at time /-J, while selecting W = 0.25, Thi = 4.77ii, and 7 = 5 
= 1, wh^e Thx was adapted to the noise level as will be discussed below. In equation (9), T 
is the field period of the video signal, which equals 20 ms in a 50 Hz environment. 
Obviously, if no motion vectors are available, t) can be taken fl. Again, as can be seen 

15 from the equations (9) and (10), the neighborhoods are selected taking implementation 
aspects, pipe-lining of the algorithm, into account. To obtain both spatial and temporal 
recursion, the set iV, may be the union of the sets given in the equations (7) and (9). 



In the noise reduction filter embodiments of Figs. 1 A and IB, the input to 
20 the difference-dependent weighted average calculation circuit lA, IB includes the current 
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sample Q and several neighboring samples O and X, whereby part of the neighboring 
samples O and X are previously filtered samples X. In an image processing system, the delay 
of the delay circuit 3 A, 3B in the feedback loop may be a line period (Fig. IB), a field 
period or a picture period (Fig. lA), plus or minus some pixel delays. When the delay is a 
5 field or picture period » the feedback loop preferably includes a motion compensation circuit 
to obtain a better matching of the pixels on which the recursive noise reduction filtering is 
based. Fig. lA shows an embodiment of an interfield noise reduction filter in which the 
delay of the delay circuit 3 A is a field or a picture delay, so that the neighboring fed-back 
pixels X may originate from both above and below the line comprising the current pixel O; 
10 the left and right adjacent pixels O are from the same line and field as the current pixel O. 
Fig. IB shows an einbodiment of an intrafield noise reduction filter in which the delay of the 
delay circuit 3B is a line delay, so that the neighboring fed-back pixels X originate from the 
line above the line comprising the current pixel O ; the left and right adjacent pixels O are 
from the same line as the current pixel ®. 

15 

In accordance with the present invention, instead of directly neighboring 
input pixels, pixels at some horizontal and/or vertical distance are used. It appeared that 
thereby, low-frequency noise components were reduced in addition to the high-frequency 
noise components which can also be reduced when directly neighboring input pixels are used. 

20 In one preferred embodiment, the recursive noise reduction filter receives 5 filtered pixels 
from the previous line having a distance of 4 pixels between two successive input pixels, 3 
unfiltered pixels from the present line having a distance of 2 pixels between two successive 
input pixels. A ringing effect occurring at edges appeared to be reduced when the filtered 
input samples from the previous line (neighborhood were taken from positions shifted in 

25 the horizontal direction line-altematingly by +1, 0, -1, 0, +1, ... pixels. Many variations in 
the inter-pixel distance, the number of pixels used, and the magnitude of the line-alternating 
shift in the position of the filtered input pixels taken from the previous line are possible. In 
one embodiment, the inter-pixel distance depends on an edge-detection such that the inter- 
pixel distance decreases with an increasing difference between a current pixel and one of the 

30 neighboring pixels (e.g. the neighboring pixel having the largest distance to the current 
pixel). The inter-pixel distance may vary separately for left and right neighboring pixels. A 
simple alternative for an edge-dependent switching of the filter is to give the pixel directly 
above the current pixel a weighting coefficient which is larger, for example, four times 
larger, than the weight it would have received in view of other considerations. 
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Figs. 2A-2D show several configurations of neighboring pixels. Fig. 2A 
shows the neighborhoods of formulae 6 and 7. Figs. 2A-2D show the line-alternating shift by 
+/- 1 pixel in the horizontal direction. 

Fig. 3 shows an embodiment of a transversal noise reduction filter in 
S accordance with the present invention. The input signal is applied to a tapped delay line 3C 
comprising a delay circuit H providing about one line delay, pixel delay circuits P and 
switchable two-pixel delay circuits 2P. The switchable two-pixel delay circuits 2P have a 
control input CI; if a control signal is applied to these control inputs CI, the delay period is 
shortened to a single pixel period. This can easily be achieved if the switchable two-pixel 

10 delay circuits 2P comprise a series connection of two pixel delay circuits P, and a switch to 
select the output of the first or the second pixel delay circuit P under control of the control 
signal applied to the control input CI as shown in Fig. 4. Switches Sl-SS select taps of the 
delay line 3C in a line-alternating manner to provide the sequence of pixel neighborhoods 
shown in Figs. 2A-2D. Outputs of the switches Sl-SS are applied to an averaging circuit IC 

IS for providing S pixels X of the previous line thereto. The input of the noise reduction filter is 
also ^lied to a cascade connection of two switchable two-pixel delay circuits 2P, so as to 
provide a delay line having three taps for providing three pixels O of the current line. The 
input of the noise reduction filter is further applied to an edge detector 41 for generating the 
control input signal CI for the two pixel delay circuits 2P. 

20 

An attractive implementation of the difference-dependent weighted average 
calculating circuit is given in Fig. S. The differences of all pixels in the filter window Nl 
plus N2 (in Fig. 5 indicated as Pni .. PnJ with respect to the current input sample Pc, are 
calculated by subtracters S and absolute value determining circuits 7, and compared with a 

2S threshold Th| by comparators 9. The pixels for which the difference with the current sample 
is below the threshold Thi, are averaged and the result is applied to the output of the noise 
reduction filter which is also the input of the delay circuit. 

This action is carried out by multiplexers 1 1 controlled by the 
comparators 9 to fiimish a weighting coefficient 0 when the ditference is above the threshold 

30 Th, and to furnish a weighting coefficient a when the difference is below the threshold Th,. 
Multipliers 13 multiply the neighboring pixels Pn with their respective weighting coefficients. 
The circuit of Fig. 5 is somewhat simplified with regard to equation (4): those differences 
between the neighboring pixel values Pn and the current pixel value Pc which are smaller 
than the threshold Th^ result in a coefficient a for the corresponding neighboring pixel value 
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Pn, while the differences exceeding the threshold value Thi result in a coefficient 0 for the 
corresponding neighboring pixel value Pn. The current sample Pc is added to the weighted 
neighboring pixels Pn by adders IS, whose output signals are summed by an adder 17. The 
output of the adder 17 is multiplied by a gain coefficient to yield the ou^ut signal of the 
S difference-dependent weighted average filter. When a equals 1, a simple average is used; 
when a differs from 1 , a weighted average is used. 

Rather than applying binary valued coefficients only, three or four 
different coefficient values (alpha 1, 2....n) can be applied, where the coefficients with the 

smallest value are assigned using the highest threshold (Thi, Thj, ThJ. Further as 

10 indicated in equation (2), the weights for previously filtered pixels can be selected different 
03 rather than o). 

As mentioned hereinbefore, the threshold Thi (and therefore also 7^, 
which has a fixed relation to Thi) is preferably adapted to the noise level. A global 

IS adaptation (Le, an adaptation for a whole picture) can be thought of and indeed proved 
useful. Hereinafter, a somewhat more sophisticated option adapting to local image 
characteristics is described. To this end, the image is divided into non-overlapping bloclcs 
BGOf where ]C ^ pC, Y)^ is the center of the block. To each block a value of Thi assigned, 
the calculation of which is based upon the Thi value in the previous field (temporal recursive 

20 adaptation process): 

Th,(X, t) = 77ii(X, t'T)- A(X, 0 (10) 

with: 

A(X, 0 - C, ./ 53 I F^X t-T) - FiX^x, t-T) \ - MinMad(c) \ (H) 

where MinMad is an estimated value of the noise level in the field, and Q is a constant. 
A possible simplification is to use a sign function according to: 

A(X, r) = . SIGN/ 53 I F^X * t-T) - F(X + x, t-T) \ - MinMad(t) \ (12) 

where SIGUfa) is defined according to: 

SION(a). {:!;<«<»> 03) 
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Experiments showed that MinMadft) is preferably equal to the minimum in a field at time i 
of the motion-compmsated summed absolute difTerence over a block of two successive fields: 

MinMadit) = 3«/i E I ^(«» O -D(2f, 0, r - T) | (14) 

where Q,QCp 0 is the displacement vector found with a motion estimator for the block BQO at 
time /. The philosophy behind this choice is that MinMadft) thus reflects the noise in the 
S picture assuming that the estimator at least at one block of the image is converged 
completely. 

In an attractive implementation, the motion estimator and the noise 
reduction circuit would share the picture memories, which is possible because the sum in 
10 equation (14) corresponds to the match error of the motion estimator. In tiiis situation, 
however, the measured MinMadft) corresponds to the reduced noise level, which is 
preferably corrected for the amount of filtering applied. Experimentally, it was verified that 
the following correction, the result of which is called ModMadft), yields satisfactory results: 

ModMadiO = ModMad{t - T) + Modit) (15) 



where Mod ft) is found according to: 



Mod{t)-^C^. 



MinMadjt) ^ModMad{t-T) 



(16) 



IS where BQS) is the block where MinMadft) was found, while Q and again are 

experimentally optimized constants. The first time ModMadft) is calculated, Modmadft-T) is 
assumed to be zero. 



Rather than adapting Thi per block in the picture, or additional to it, local 
20 adaptation of 7 and 5 in equation (1) can be considered. 



It should be noted that the above-mentioned embodiments illustrate rather 
than limit the invention, and that those skilled in the art will be able to design many 
alternative embodiments without departing from the scope of the appended claims. Whenever 
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a first item is said to dejpend on a second item» it should be borne in mind that it is not 
excluded that the first item also depends on a third item. 

As an alternative to the use of the recursive noise reduction filter of 
Fig. 5 using all neighboring samples which differ by less than a (noise adapted) threshold 
5 from the current pixel value, it is possible to average the n least differing (compared to the 
current pixel) pixel values, in which case n depends on the noise level. 

In a television signal receiver having a luminance noise reduction filter 
and a chrominance noise reduction filter, filter coefficients of the chrominance noise 
reduction filter are preferably dependent on differences between neighboring luminance pixel 
10 values. This yields as an unexpected advantage that cross-color is reduced. This effect can be 
explained as follows. Suppose an e.g. horizontal high-frequency luminance pattern. The 
horizontal high-frequency luminance pattern will cause an undesired cross-color having 
vertical components. To avoid that the horizontal high-frequency information will be 
damaged by the noise reduction filtering, the noise reduction filtering will be predominandy 
IS vertically oriented. Such a vertically oriented noise reduction filtering will not only filter the 
vertical noise components, but also the vertical cross-color components and thus reduce the 
cross-color. 

Thus, in accordance with the present invention, a family of noise- 
reduction filters is proposed, which experimentally shows a particularly good suitability for 

20 noise reduction application in image data processing. It concerns a class of spatial and spatio- 
temporal filters, for which options are given to adapt to noise level and local image 
characteristics. In embodiments of the noise reduction filter in accordance with the present 
invention, weights are related to the absolute difference between samples. It is shown that 
particularly multi-dimensional recursive variants of this nonlinear filter fanuly are attractive 

25 for noise reduction of images. The recursivity can be designed to facilitate implementation at 
high processing speed, Le. the definition of the noise reduction filter allows for pipe-lining. 
In case of temporal recursion, motion-compensation turns out to increase the performance. 
An attractive implementation of the weight calculation circuit is provided, and methods are 
indicated to adapt the filter to the noise level in the picture and to the local characteristics of 

30 the picture. 
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Claims: 



1. A noise reduction filter comprising: 

delay means (3) for furnishing delayed signal samples (X); and 

a filter (1) coupled to receive input signal samples (O,®) and said delayed 

signal samples (X) to fiimish noise-reduced signal samples, wherein 
5 said samples (Pn,..PnB) applied to said filter (1) are not-directly 

neighboring samples. 

2. A noise reduction filter as claimed in claim 1, wherein a distance between 
said not-directly neighboring samples depends on an edge-detection such that said distance 

10 decreases with an increasing difference between a current sample (®,Pc) and one of said not- 
directly neighboring samples. 

3. A noise reduction filter as claimed in claim 1, wherein said delayed 
samples (X) from a previous line are taken from positions line-altematingly shifted in the 

IS horizontal direction. 

4. A noise reduction filter as claimed in claim 1, wherein said input samples 
(0,0) are all on a first horizontal line of an image signal, while said delayed signal samples 
(X) are all on one or more lines other than said first horizontal line. 

20 

5. A noise reduction filter as claimed in claim 1, wherein said filter (1) is a 
weighted average filter, and weighting coefficients assigned to samples (Pn|..PnJ of said 
input signal (O) and said delayed signal (X) depend on respective differences between a 
current sample (S,Pc) of said input signal on the one hand and said samples (Pnf.PnJ of 

25 said input signal (O) and said delayed signal (X) on the other hand. 

6. A noise reduction filter as claimed in claim S, wherein a first weighting 
coefficient is assigned to samples (Pn|..PiO of said input signal (O) and said delayed signal 
(X) differing by less than a threshold value from said current sample (®,Pc) of said input 

30 signal, while weighting coefficients differing from said first weighting coefficient are 
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assigned to samples (Pni..PnJ of said input signal (O) and said delayed signal (X) differing 
by more than said threshold value from said current sample (©,Pc) of said input signal. 

7^ A noise reduction filter as claimed in claim 6, wherein a second weighting 

5 coefficient smaller than said first weighting coefficient is assigned to those samples (Pni..Pna) 
which differ from the current sample (0,Pc) by more than said first-mentioned threshold 
value and by less than a second threshold value, which second threshold value is larger than 
said first threshold value. 

IQ A noise reduction filter as claimed in claim 6, wherein said threshold 

value depends on the noise level. 

9, A noise reduction filter as claimed in claim 6, wherein said threshold 
value depends on a minimum in a field of a motion-compensated difference between two 

IS successive fields. 

10. A noise reduction filter as claimed in claim 5, wherein weighting 
coefficients for a chrominance signal noise reduction filtering depend on differences between 
neighboring luminance sample values. 

20 

XI. A noise reduction filter as claimed in claim 1, wherein said delay means 

(3) comprise motion vector compensation means. 

12. An image signal receiver comprising a signal input for receiving an image 
25 signal, a signal processor for processing said image signal, and a display unit for displaying 

the processed image signal, wherein said signal processor comprises a noise reduction filter 
as claimed in any of the preceding claims. 

13, A noise reduction filtering method comprising the steps of : 
30 furnishing (3) delayed signal samples (X); and 

filtering (1) input signal samples (O,©) and said delayed signal samples 
(X) to furnish noise-reduced signal samples, wherein 

said samples (Pnj..PnJ applied to said filter (1) are not-directly 

neighboring samples. 
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